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PATENT 

\j Attorney Docket No.: 0151 14-071000US 

Client Reference No.: A1396 

DETERMINISTIC OUTPUT RESPONSE ANALYZER 

BACKGROUND 

[0001] The present invention relates generally to testing integrated circuits, and more 
5 particularly to built-in-test circuits and output response analyzers for integrated circuits. 
[0002] Integrated circuits are typically tested multiple times while they are manufactured. 
Often, individual circuits are tested while they are part of a wafer, which contain thousands of 
integrated circuits. Nonfunctional die are identified, for example with an ink spot, during a test 
referred to as wafer sort. After wafer sort, the die are separated and packaged. The packaged 

10 devices are testing again — this is referred to as final test. Additional testing may be done, for 
example sample devices may be tested under extreme environmental conditions. 
[0003] During these tests, test data, also referred to as test vectors, which typically include data 
and clock signals, are provided to the integrated circuit by a tester. The input test data may be 
generated by a circuit or software test pattern generator. Conventionally the integrated circuit 

1 5 operates on the input test data and provides output test data back to the tester. An output 
response analyzer in the tester checks the output test data for errors, and passes or rejects the 
device. 

[0004] It is desirable to test each node in an integrated circuit. However, integrated circuits are 
becoming extremely complicated and may include hundreds of thousands of logic elements. At 

20 the same time, it is desirable to reduce the number of pins on the device in order to simplify 

device packaging and reduce printed circuit board complexity and space. The result is that many 
internal nodes on integrated circuits are difficult to reach electrically by device pins. 
[0005] Accordingly, it is desirable to include test circuitry on the integrated circuit itself, such 
that these internal nodes may be more thoroughly tested. Further, it is desirable to provide an 

25 internal test circuit that is capable of testing using test patterns other than simple all ones or all 
zeros patterns. Also, it is desirable to be able to perform such tests without the addition of 
complicated circuitry. It is also desirable that the internal circuitry require no or a limited 
number of pins, such that device pin count may be maintained. 
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SUMMARY 

[0006] Accordingly, embodiments of the present invention provide circuits, methods, and 
apparatus for output response analyzers that may be used during the testing of integrated circuits. 
Embodiments of the present invention compare current output test data with previous output test 
5 data. In this way, repetitive test data such as checkerboard patterns may be used while keeping 
the built-in-test circuitry very simple. Embodiments may further provide the combining of 
outputs of several built-in-test circuits into as few as one signal that may be provided as an 
output. This output may be a dedicated test pin (or pad), it may be an output pin, or it may be 
another type of device pin. 
10 [0007] A better understanding of the nature and advantages of the present invention may be 
gained with reference to the following detailed description and the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0008] Figure 1 is a simplified block diagram of a programmable logic device that can 
1 5 implement embodiments of the present invention; 

[0009] Figure 2 is a block diagram of an electronic system that may incorporate embodiments 
of the present invention; 

[0010] Figure 3 is a block diagram of a conventional apparatus used for testing an integrated 
circuit that may be improved by incorporation of an embodiment of the present invention; 
20 [001 1] Figure 4 is a block diagram of an apparatus used in testing integrated circuits in 
accordance with an embodiment of the present invention; 

[0012] Figure 5 A is a block diagram of a built-in self-test (BIST) circuit or output response 
analyzer (ORA) that is consistent with an embodiment of the present invention, and Figure 5B is 
a block diagram of an alternative built-in self-test or output response analyzer consistent with an 
25 embodiment of the present invention; 

[0013] Figure 6 is a flowchart of a method of testing an integrated circuit consistent with an 
embodiment of the present invention; . 

[0014] Figure 7 is a schematic of a specific implementation of a built-in self-test circuit or 
output response analyzer consistent with an embodiment of the present invention; and 
30 [0015] Figure 8 is a timing diagram for the specific implementation of the present invention 
shown in Figure 7. 
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DESCRIPTION OF EXEMPLARY EMBODIMENTS 
[0016] Figure 1 is a simplified partial block diagram of an exemplary high-density 
programmable logic device 100 wherein techniques according to the present invention can be 
5 utilized. PLD 100 includes a two-dimensional array of programmable logic array blocks (or 
LABs) 102 that are interconnected by a network of column and row interconnects of varying 
length and speed. LABs 102 include multiple (e.g., 10) logic elements (or LEs), an LE being a 
small unit of logic that provides for efficient implementation of user defined logic functions. 
[0017] PLD 100 also includes a distributed memory structure including RAM blocks of 

10 varying sizes provided throughout the array. The RAM blocks include, for example, 512 bit 
blocks 104, 4K blocks 106 and a M-Block 108 providing 51 2K bits of RAM. These memory 
blocks may also include shift registers and FIFO buffers. PLD 100 further includes digital signal 
processing (DSP) blocks 110 that can implement, for example, multipliers with add or subtract 
features. I/O elements (IOEs) 1 12 located, in this example, around the periphery of the device 

1 5 support numerous single-ended and differential I/O standards. It is to be understood that PLD 
100 is described herein for illustrative purposes only and that the present invention can be 
implemented in many different types of PLDs, FPGAs, and the like. Also, the present invention 
may be implemented in other types of integrated circuits, such as those including only fixed, 
nonprogrammable circuits, or those having a combination of fixed and programmable circuit 

20 blocks. 

[0018] While PLDs of the type shown in Figure 1 provide many of the resources required to 
implement system level solutions, the present invention can also benefit systems wherein a PLD 
is one of several components. Figure 2 shows a block diagram of an exemplary digital system 
200, within which the present invention may be embodied. System 200 can be a programmed 

25 digital computer system, digital signal processing system, specialized digital switching network, 
or other processing system. Moreover, such systems may be designed for a wide variety of 
applications such as telecommunications systems, automotive systems, control systems, 
consumer electronics, personal computers, Internet communications and networking, and others. 
Further, system 200 may be provided on a single board, on multiple boards, or within multiple 

30 enclosures. 
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[0019] System 200 includes a processing unit 202, a memory unit 204 and an I/O unit 206 
interconnected together by one or more buses. According to this exemplary embodiment, a 
programmable logic device (PLD) 208 is embedded in processing unit 202. PLD 208 may serve 
many different purposes within the system in Figure 2. PLD 208 can, for example, be a logical 
5 building block of processing unit 202, supporting its internal and external operations. PLD 208 
is programmed to implement the logical functions necessary to carry on its particular role in 
system operation. PLD 208 may be specially coupled to memory 204 through connection 210 
and to I/O unit 206 through connection 212. 

[0020] Processing unit 202 may direct data to an appropriate system component for processing 

10 or storage, execute a program stored in memory 204 or receive and transmit data via I/O unit 
206, or other similar function. Processing unit 202 can be a central processing unit (CPU), 
microprocessor, floating point coprocessor, graphics coprocessor, hardware controller, 
microcontroller, programmable logic device programmed for use as a controller, network 
controller, and the like. Furthermore, in many embodiments, there is often no need for a CPU. 

15 [0021] For example, instead of a CPU, one or more PLD 208 can control the logical operations 
of the system. In an embodiment, PLD 208 acts as a reconfigurable processor, which can be 
reprogrammed as needed to handle a particular computing task. Alternately, programmable logic 
device 208 may itself include an embedded microprocessor. Memory unit 204 may be a random 
access memory (RAM), read only memory (ROM), fixed or flexible disk media, PC Card flash 

20 disk memory, tape, or any other storage means, or any combination of these storage means. 

[0022] Figure 3 is a block diagram of a conventional apparatus used for testing an integrated 
circuit that may be improved by incorporation of an embodiment of the present invention. 
Included are an integrated circuit, the circuit-under-test (CUT) 300, test pattern generator (TPG) 
310, and output response analyzer 320. 

25 [0023] An input clock is provided on line 305 to the test pattern generator 310. The test 

pattern generator generates input data and clock signals and provides them to the circuit-under- 
test 300 on line 315. The circuit-under- test 300 receives this test data and provides an output on 
line 317 to the output response analyzer 320. The output response analyzer may optionally 
receive information from the test pattern generator 310 on line 325. The output response 

30 analyzer 320 examines the test output data on line 3 17 in light of the expected data. If the data 
provided by the circuit-under-test on line 317 is correct, then no error signal is provided on line 
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335 by the output response analyzer. If an error exists in the data read out from the circuit- 
under-test on line 317, then the output response analyzer 320 indicates this as an error signal on 
line 335. 

[0024] Figure 4 is a block diagram of an apparatus used in testing integrated circuits in 
5 accordance with an embodiment of the present invention. This block diagram includes a circuit- 
under-test 400 and a test pattern generator 410. This figure, as with the other included figures, 
is shown for exemplary purposes only and does not limit either the possible embodiments of the 
present invention or the claims. 

[0025] The circuit-under-test may be an integrated circuit, a combination of integrated circuits 
10 such as a module or other hybrid device or other circuit type. If the circuit-under- test 400 is an 
integrated circuit, it may be a field programmable device such as the device of Figure 1. The test 
pattern generator 410 may be a software program or module, a hardware circuit, firmware 
apparatus, or other type of generator. The test pattern generator 410 may be part of a larger test 
system, for example a test system for testing integrated wafers or packaged devices. 
15 [0026] In this embodiment, an output response analyzer is included in the functionality of the 
circuit-under-test 400. If the circuit-under-test 400 is a field programmable logic device, such as 
the field programmable logic device shown in Figure 1, the circuitry required for an output 
response analyzer may be formed using one or more of the logic elements 110. 
[0027] The data may be received by the circuit under test 400 through a JTAG port, dedicated 
20 pin (or pad), multiplexed pin, or other pin. The error signal may similarly be provided through a 
JTAG port, dedicated pin, multiplexed pin, or other pin. 

[0028] The testing performed may be done during wafer sort or final test, as mentioned above. 
This testing may also be done during power up, for example as part of a self diagnostic routine, 
in the field as part of a field test or error analysis, or at other appropriate times. 

25 [0029] It is also important to check the functionality of the output response analyzer that is part 
of the circuit-under-test 400. For example, the output response analyzer may be inoperative such 
that it is incapable of producing an error signal on line 435. Accordingly an embodiment of the 
present invention provides a test pattern input, and the presence of an error on line 435 is 
checked. A error is then purposefully introduced, and the error signal on line 435 is checked 

30 again. 
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[0030] Figure 5 A is a block diagram of a built-in self-test (BIST) circuit or output response 
analyzer that is consistent with an embodiment of the present invention. This block diagram 
includes a delay circuit 500, a first compare circuit 510, state machine 520, second compare 
circuit 530, and an error memory 540. 
5 [0031] The circuitry being tested may include one or more logic elements, memory cells, or 
other types of circuitry. This circuitry provides test data on line 505 to the output response 
analyzer. The delay circuit 500 receives an input on line 505 from a portion of the integrated 
circuit that is being tested and provides delayed test data at its output. The first compare circuit 
510 receives the test data input on line 505, as well as the delayed test data on line 515. The first 
1 0 compare circuit 5 1 0 compares the output test data and the delayed output test data and provides 
an output signal on line 525 to the second compare circuit 530. The state machine 520 provides 
a control signal on line 527 to the second compare circuit 530. 

[0032] The second compare circuit 530 compares the output of the first compare circuit 510 on 
line 525 with the control signal on line 527. The second compare circuit determines whether the 

15 output of the first compare circuit 510 on line 525 is correct in light of the control signal on line 
527, and provides an output on line 535 to the error memory 540. If the test data on line 552 is 
correct, the output of the second compare circuit 530 on line 535 remains in a first state, for 
example, low. If an error is detected, the output of the second compare circuit 530 on line 535 
toggles to a second state, for example, high. This changed state is retained by the error memory 

20 540, which provides an error signal on line 545. 

[0033] Several of these error signals may be combined throughout the chip, for instance using 
a large OR gate, and provided outside of the circuit-under-test as an error signal. In one 
integrated circuit that is consistent with an embodiment of the present invention, hundreds of 
output response analyzers were used. 

25 [0034] Figure 5B is a block diagram of an alternative built-in self-test or output response 
analyzer consistent with an embodiment of the present invention. This diagram includes 
retiming blocks 550 and 555, delay circuits 560, a first compare circuit 570, state machine 575, a 
second compare circuit 580, and an error memory 590. It will be appreciated by one skilled in 
the art that variations on this and the other diagrams and schematics shown may be made 

30 consistent with embodiments of the present invention. For example, the retiming circuits 550 
and 555 may be replaced by a single retiming circuit in some embodiments. 
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[0035] Again, the circuitry being tested may be one or more logic elements, memory cells, or 
other types of circuitry. This circuitry provides test data as an input signal on line 552 to the 
built-in self-test circuit. The retiming circuits 550 and 555 retime the input signal to a clock 
signal on line 559. The delay circuit 500 receives an input on line 505 from the first retiming 
5 circuit 550, and provides a delayed signal on line 565 to the first compare circuit 570. The first 
compare circuit 510 receives this delayed signal, as well as retimed test data provided by the 
retiming circuit 555 on line 557. The first compare circuit 510 compares the delayed test data 
and the retimed test data and provides an output signal on line 572 to the second compare circuit 
580. The state machine 575 provides a control signal on line 578 to the second compare circuit 
10 580. 

[0036] The second compare circuit 580 compares the output of the first compare circuit 570 on 
line 572 with the control signal on line 578. The second compare circuit determines whether the 
output of the first compare circuit 570 on line 572 is correct in light of the control signal on line 
578, and provides an output on line 585 to the error memory 590. If the test data on line 552 is 

15 correct, the output of the second compare circuit 580 on line 585 remains in a first state. If an 
error is detected, the output of the. second compare circuit 580 on line 585 toggles to a second 
state. This change in state is retained by the error memory 590, which provides an error signal 
on line 595. As before, several of these error signals may be combined throughout the chip, for 
instance using a large OR gate, and provided outside of the circuit-under-test as an error signal. 

20 [0037] One or both of the retiming blocks 550 and 555 may be preloaded with data, set, reset, 
cleared or otherwise initialized such that they are consistent with the test output data. It 
establishes an initial condition against which the rest of the test output data is evaluated. 
[0038] Figure 6 is a flowchart of a method of testing an integrated circuit consistent with an 
embodiment of the present invention. In act 610, test data is received by a circuit-under-test. 

25 Test output data is read out of a portion of the circuit-under-test in act 620. In act 630, this test 
output data is delayed. In a specific embodiment of the present invention, the output test data is 
delayed by one clock cycle. In other embodiments of the present invention, the output may be 
delayed a different amount, for example, more than one clock cycle. 

[0039] In act 640, the output data is compared to the delayed data, thus generating a compared 
30 data output. In act 650, a control signal is generated. This control signal is an appropriate signal 
given the test data provided to the circuit-under-test. In act 660, the control signal is compared 
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to the compared data signal, thus generating an error signal. In act 670, the error signal is stored. 
In a specific embodiment of the present invention, the presence of an error bit is retained or 
latched as an error signal. In act 680, the error signal is provided as an output. 
[0040] Figure 7 is a schematic of a specific implementation of a built-in self-test circuit or 
5 output response analyzer consistent with an embodiment of the present invention. This specific 
implementation includes a first flip-flop 710, and second flip-flop 720, and third flip-flop 730, a 
first exclusive-OR gate 740, a second exclusive-OR gate 750, OR gate 760, and a fourth flip-flop 
770. 

[0041] As before, test data is received on line 705 from a portion of an integrated circuit or 
10 circuit-under-test. This data is retimed to a clock signal received on line 707. Specifically, the 
input data on line 705 is retimed by the first flip-flop 710 and the second flip-flop 730 as signals 
Ql on line 715 and Q3 on line 735. The signal Ql on line 715 is delayed by one clock cycle by 
the second flip-flop 720, and provided as an output Q2 on line 725. 

[0042] The first exclusive-OR gate 740 compares signals Q2 on line 725 and Q3 on line 735. 
1 5 If these two signals are the same, the exclusive-OR gate 740 provides a high signal, specifically 
XI on line 745 is asserted high. If these two signals are different, the output XI on line 745 of 
the first exclusive-OR gate 740 is low. 

[0043] A select or control signal is provided on line 747, for example, from a state machine or 
other logic circuit. The second exclusive-OR gate 750 compares the select line 747 with the 
20 output of the first exclusive-OR gate XI on line 745. If these two signals are equal, the output of 
the second exclusive-OR gate 750, the signal X2 on line .755, is high, while if they are different, 
the signal X2 on line 755 is low. 

[0044] When the output of the second exclusive-OR gate 750 X on line 755 is high, the OR 
gate 760 provides a high on line 765 to the fourth flip-flop 770. When this high signal is latched 

25 by the fourth flip-flop 770, the error signal on line 775 goes high, and feeds back to the OR gate 
760, thus ensuring that the signal on line 765 remains high if the signal X2 on line 755 returns to 
a low state. In this way, the presence of a high data bit in a stream of data of the signal X2 on 
line 755 toggles the error signal 775 to a high, where it remains until the fourth flip-flop 770 is 
reset — that is, if it is reset before the circuit-under-test is discarded as being nonfunctional. In 

30 this way, a single error in the input bitstream received on line 705 causes the error signal on line 
775 to be asserted high. 



[0045] This specific embodiment provides a simple yet elegant output response analyzer that is 
capable of determining the presence of errors in several different test patterns. For example, an 
all ones (1 1 1 1) or all zeros pattern may be checked by setting the select or control signal on line 
747 to a low. Similarly, a checkerboard (010101) or ncheckerboard (101010) pattern may be 
5 verified with the select signal set to a high level. 

[0046] More complicated patterns, such as 1 1001 100, can also be verified. In this case, the 
select signal toggles between high and low each data bit. This can easily be generated by a 
divide by two circuit clocked by the clock signal on line 707. Other patterns may be verified 
using more complicated state machines to generate the select or control signal on line 747. 
10 Moreover, greater depths may be used by embodiments of the present invention, for example the 
exclusive-OR gate 740 may check more than two bits at a time, for example, four or eight bits 
may be checked, allowing for more complicated test patterns. 

[0047] It will be appreciated by one skilled in the art that variations on this circuit may be 
made consistent with an embodiment of the present invention. For example, first flip-flop 710 
1 5 and the third flip-flop 730 may be combined. Also, the second exclusive-OR gate 750 may be 
placed in front of the second flip-flop 720. 

[0048] Figure 8 is a timing diagram for the specific implementation of the present invention 
shown in Figure 7. This timing diagram includes input signals test data input 810 and clock 820, 
and resulting signals Ql 830, Q2 840, XI 850, X2 860, and error 870. 

20 [0049] The input signal 810 would ideally be a checkerboard pattern as described above, 

except bit 812 is missing. The input signal 810 is a test data output provided by a portion of an 
integrated circuit or circuit-under- test. The input signal 810 is retimed to the clock signal 820 as 
Ql 830, which is equal to Q3, 830. The signal Ql 830 is delayed by one clock cycle and 
provided as signal Q2 840. 

25 [0050] If signal XI 815 is the exclusive-OR product of Q3 830 and Q2 840. Accordingly, 
signal XI 850 remains low of the until pulse 852, which is caused by the missing data bit 812 
above. In this particular case, the control or select signal is high, accordingly X2 816 goes high 
at pulse 862. The error signal 870 to is asserted high at 872, where a remains in despite X2 860 
and returning low at 864. 

30 [0051] The above description of exemplary embodiments of the invention has been presented 
for the purposes of illustration and description. It is not intended to be exhaustive or to limit the 
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invention to the precise form described, and many modifications and variations are possible 
light of the teaching above. The embodiments were chosen and described in order to best 
explain the principles of the invention and its practical applications to thereby enable others 
skilled in the art to best utilize the invention in various embodiments and with various 
modifications as are suited to the particular use contemplated. 
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